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BRANCH PREDICTION METHOD USING ADDRESS TRACE 



This application relies for priority upon Korean Patent Application No. 1999- 
50627, filed on November 15, 1999, the contents of which are herein incorporated by 
reference in their entirety. 

Background of the Invention 

1. Field of the Invention 

The present invention relates to a branch prediction method and, more particularly, 
to a branch prediction method using an address trace. 

2. Description of the Related Art 

Fig. 1 shows fourth generation microarchitecture, which is cited from Figure 1 of a 
paper entitled "Trace Processors: Moving to Fourth Generation Microarchitecture," IEEE 
Computer, pp. 68-74, September 1997, by James E. Smith & Sriram Vajapeyam. In Fig. 1, 
(a) is the first generation microarchitecture serial processors which began in the 1940s with 
the first electronic digital computers and ended in the early 1960s. The serial processors 
fetch and execute each instruction before going to the next. Diagram (b) is the second 
generation microarchitecture using pipelining. Such architectures were the norm for high- 
performance processing until the late 1980s. Diagrams (c) and (d) are the third and fourth 
generation microarchitectures that are characterized by superscalar processors. The third 
and fourth generation architectures first appeared in commercially available processors in 
the late 1980s. 

As shown in Fig. 1, high-performance processors of the next generation will be 
composed of multiple superscalar pipelines, with some higher level control that dispatches 
groups of instructions to the individual superscalar pipes. The superscalar processors, 
which can patch a group of instructions to a cache block at the same time and process the 
instructions in parallel, are afflicted with performance degradation resulting from pipeline 
stall and abort of missed instruction rather than prediction error. Therefore, correct branch 
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prediction is very significant to the superscalar processors. 

As mentioned above, a critical technology to achieve high performance of 
superscalar processors is to optimally use pipelines. The most significant design factor is a 
branch prediction method. A branch predictor operates to predict the outcome of a branch 
5 instruction before performing a condition check of the branch instruction based on a 

predetermined branch prediction approach. A central processing unit (CPU) then fetches 
the next instruction according to the predicted result. A pipeline technique is adopted to 
solve a pipeline stall phenomenon that causes performance degradation of a CPU. 
However, when a branch prediction is missed, many instructions from the incorrect code 
10 section may be in various stages of processing in the instruction execution pipeline. 

On encountering such a misprediction, instructions following the mispredicted 
conditional branch instruction in the pipeline are flushed, and instructions from the other, 
P correct code section are fetched. Flushing the pipeline creates bubbles or gaps in the 
?i pipeline. Several clock cycles may be required before the next useful instruction completes 
it; execution, and before the instruction execution pipeline produces useful output. Such 
y incorrect guesses cause the pipeline to stall until it is refilled with valid instructions, this 
= li delay is called the mispredicted branch penalty. 

* Generally, a processor with 5-step pipelines has a branch penalty of two cycles. For 

Uk example, in 4-way superscalar design, 8 instructions are subject to loss. If a pipeline is 
2SZ expanded, more instructions are subject to loss and the branch penalty increases. Since 
O programs generally branch in every 4 or 6 instructions, misprediction causes acute 
performance degradation in a deep pipeline design. 

There have been efforts to reduce the above-mentioned branch penalty. Recently, a 
trace processor using a trace cache has been applied. The trace processor is disclosed in the 
25 paper "Trace Processors: Moving to Fourth Generation Microarchitecture," by James E, 

Smith & Sriram Vajapeyam. 

Fig. 2A shows a dynamic sequence of basic blocks embedded in a conventional 
instruction cache 21. Fig. 2B shows a conventional trace cache 22. Referring now to Fig. 
2A, arrows indicate a branch "taken" (jumping to target code section). In the instruction 
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cache 21, even multiple branch predictions created at every cycle require 4 cycles to fetch 
instructions in basic blocks "ABCDE" because instructions are stored in discontinuous 
caches. 

Accordingly, some have proposed a specific instruction cache to capture long 
5 dynamic instruction sequences. Each line of the specific instruction cache stores a snapshot 

or trace of a dynamic instruction stream, as shown in Fig. 2B. This cache is referred to as a 
trace cache 22, which is disclosed in a paper entitled "Expansion Caches for Superscalar 
Processors," Technical Report CSL-TR-94-630, Stanford Univ., June 1994, by J. Johnson; 
U. S. Patent No. 5,381,533 entitled "Dynamic Flow Instruction Cache Memory Organized 
10 Around Trace Segments Independent Of Virtual Address Line," issued on January 1995 to 

A. Peleg & U. Weiser; and a paper entitled "Trace Cache; A Low Latency Approach To 
High Bandwidth Instruction Fetching," Pro. 29th Int'l Symp. Microarchitecture, pp. 24-34, 
O December 1996, by E. Rotenberg, S. Bennett, & J. Smith. 

'C\ Furthermore, the trace cache 22 is disclosed in a paper entitled "Improving Trace 

iC! Cache Effectiveness with Branch Promotion and Trace Packing," Proc. 25th IntT Symp. 
ill Computer Architecture, pp. 262-271, June 1998, by Sanjay Jeram Patel, Marius Evers, and 
1 1 Yale N. Patt; a paper entitled "Evaluation of Design Options for the Trace Cache Fetch 
* Mechanism," IEEE TRANSACTION ON COMPUTER, Vol. 48, No. 2, pp. 193-204, 

M February 1999, by Sanjay Jeram Patel, Daniel Holmes Friendly & Yale N. Patt; and a 
2 Qh paper entitled "A Trace Cache Microarchitecture and Evaluation," IEEE TRANSACTION 
O ON COMPUTER, Vol. 48, No. 2, pp. 1 1 1-120, February 1999, by Eric Rotenberg, Steve 
Bennett, and James E. Smith. 

A dynamic sequence, which is identical to the discontinuous blocks in the 
instruction cache 21 shown in Fig. 2 A, is continuous in the trace cache 22 shown in Fig. 
25 2B. Therefore, instructions stored in the trace cache 22 can sequentially be executed 

without repeated branch to an address including an instruction according to a 
conventionally programmed routine. This makes it possible to prevent a branch penalty 
which occurs in conventional prediction techniques. And, instructions stored in 
discontinuous positions of the instruction cache 21 are continuously stored in the trace 
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cache to carry out improved parallel processing. 

Because it stores an instruction itself, the trace cache 22 requires decoding to an 
address corresponding to the instruction. And because the trace cache 22 repeatedly stores 
even repetitively executed instructions according to their execution order, a chip size of the 
trace cache 22 increases too much. In order to have enough size to store all instructions, 
the trace cache 22 inevitably increases in chip size and manufacturing cost. 

Summary of the Invention 

Therefore, it is an object of the present invention to provide a branch prediction 
approach using a trace cache, which can shorten address decoding time and decrease chip 
size and manufacturing cost. 

According to the aspect of the present invention, a branch prediction method uses a 
trace cache. If a routine composed of unrepeated instructions is to be executed, an address 
corresponding to each instruction in the trace cache according to an order of executed 
instructions is stored. If a routine composed of repeated instructions is carried out, a 
routine start address, a routine end address, current access times of the routine, and total 
access times of the routine are counted and stored. 

If the routine composed of the repeated instructions is carried out, the trace cache 
includes loop counters for counting the current access times and the total current access 
times. If values of the loop counters are identical to each other, a start address that will be 
subsequent to the routine is addressed. If the branch prediction is missed, the loop counter 
is recomposed using the latest updated loop count value. 

Brief Description of the Drawings 

The foregoing and other objects, features and advantages of the invention will be 
apparent from the more particular description of preferred embodiments of the invention, 
as illustrated in the accompanying drawings in which like reference characters refer to the 
same parts throughout the different views. The drawings are not necessarily to scale, 
emphasis instead being placed upon illustrating the principles of the invention. 
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Fig. 1 contains schematic functional block diagrams which illustrate various 
microarchitectures including fourth-generation microarchitectures. 

Fig. 2 A is a schematic diagram which shows a dynamic sequence of basic blocks 
stored in a conventional instruction cache. 

Fig. 2B is a schematic diagram which illustrates a conventional trace cache. 

Fig. 3 is a schematic diagram which illustrates one example of a repetitive 
instruction pattern. 

Fig. 4 is a schematic diagram which illustrates a pattern where instructions shown 
in Fig. 3 are stored in a trace cache according to prior art. 

Fig. 5 is a schematic diagram which illustrates a structure of an address trace cache 
according to the present invention. 

Fig. 6 is a schematic diagram which illustrates a pattern where instructions shown 
in Fig. 3 are stored in a trace cache according to the present invention. 

Description of Preferred Embodiments of the Invention 

A new and improved trace cache stores an address trace itself corresponding to an 
instruction with a decoded form, thus shortening address decoding time for each 
instruction. The new and improved trace cache uses a small amount of trace cache memory 
in storing an address trace to a repetitively executed routine, thus decreasing chip size and 
manufacturing cost. 

Fig. 3 illustrates one example of a repetitive instruction pattern. In a routine 1, 
operations A and B are repeated 30 times. When the routine 1 is finished, a routine 2 is 
carried out wherein operations C, D, and E are sequentially repeated 20 times. When the 
routine 2 is finished, a routine 3 is carried out wherein operations F and G are repeated 40 
times. 

Assuming that, for example, the routines shown in Fig. 3 are carried out, Fig. 4 
shows instructions that are stored in a trace cache 22 according to prior art. Referring now 
to Fig. 4, the trace cache 22 stores instructions based upon their execution order 
irrespective of the fact that executed instructions are repeatedly carried out. Accordingly, 



SAM-169 



the trace cache 22 requires a data storing area for storing 60 instructions (2 instructions x 
30 times repetition = 60) for routine 1, a data storing area for storing 60 instructions (3 
instructions x 20 times repetition = 60) for routine 2, and a data storing area for storing 80 
instructions (2 instructions x 40 times repetition = 80) for routine 3. That is, a total of 200 

5 data storing areas are required for storing instructions for routines 1, 2, and 3 shown in Fig. 

3. If 32 bits are required for storing each of the instructions, a data storing area of total 
6400 bits (i.e., 800 bytes) is required for routines 1, 2, and 3. 

In Fig. 5, in accordance with the invention, an address trace cache 220 is composed 
of a start address for storing an address where each routine is started, an end address for an 

10 address where each routine is finished, an access current loop counter for counting access 

times of a corresponding routine, and an old access loop counter for indicating total access 
times of the routine. 

G For example, if the information of instructions executed in routine 1 is indicated 

Z\ the address trace cache 220, the start address and the end address of routine 1 are stored in 
it: the trace cache 220. Then, current access time of routine 1 is stored in the current access 
fif loop counter while total access times (e.g., 30 times) of routine 1 is stored in the old access 
555 loop counter. As access of the routine is repeated, a value of the current access loop 
; : counter is increased. If the value of the current access loop counter is identical to that of 

U the old access loop counter, routine 1 is finished and a start address of routine 2 is stored as 
2C a next fetch point (NFP). 
13 As shown in Fig. 3 and Fig. 5, if routine 1 through 3 are successively carried out, 

they can be stored in the address trace cache 220 by the above-mentioned manner, 
respectively. If routines 1 through 3 are not repeatedly carried out, the address of each 
instruction composing routines 1 through 3 is sequentially written therein. When branch 
25 prediction is missed, the loop counter is recomposed with the latest updated loop count 

value. 

Referring now to Fig. 6, if, for example, a routine 1 shown in Fig. 3 is stored in the 
address trace cache 220, an address of an initially executed instruction A is stored into a 
start address of routine 1 while an address of a finally executed instruction B is stored into 
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an end address thereof. Since total repetition times of the routine 1 is 30 5 an old access 
loop counter is stored as 30. Whenever routine 1 is repeatedly carried out, a value of a 
current access loop counter increases by 1. In the same manner, information of routines 2 
and 3 is stored in the address cache 220. 

As shown in Fig. 6, since the address cache 220 is composed of an address where 
each routine is started, an address where each routine is finished, a current access loop 
counter, and an old access loop counter, only four data storing areas are required to store 
information of a repeated routine. Therefore, total 12 data storing areas are required to 
store routines 1 through 3 in the address trace cache 220. In this case, if 32 bits are utilized 
to store each piece of information, a total of 384 bits (i.e., 48 bytes) are required to store 
routines 1 through 3. This is smaller by about 16.7 times than a data storing area utilized in 
a conventional trace cache. 

Such an effect may be significant, as the number of repeated instructions in a 
routine becomes large or the number of repetitions of instructions rises. A trace cache of 
this invention utilizes a data storing area that is considerably reduced in comparison with a 
conventional trace cache, resulting in decreased chip size and manufacturing unit price. 
Moreover, the trace cache stores an address trace itself to each instruction with a decoded 
form, reducing an address decoding time of the instruction. 

While this invention has been particularly shown and described with references to 
preferred embodiments thereof, it will be understood by those skilled in the art that various 
changes in form and detail may be made therein without departing from the spirit and 
scope of the invention as defined by the appended claims. 



SAM- 169 



CLAIMS 



1 . A branch prediction method using a trace cache comprising the steps of: 
if a routine composed of unrepeated instruction is to be executed, storing an 

address corresponding to each instruction in the trace cache according to an order of 
executed instructions; and 

if a routine composed of repeated instructions is to be executed, storing a routine 
start address, a routine end address, current access times of the routine, and total access 
times of the routine. 

2. The method of Claim 1, wherein the trace cache includes loop counters for 
counting the current access times and the total access times, if the routine composed of 
repeated instructions is carried out. 

3. The method of Claim 2, further comprising addressing a start address which 
will be subsequent to the routine, if values of the loop counters are identical to each other. 

4. The method of Claim 2, further comprising recomposing the loop counter if 
branch prediction is missed, wherein the loop counter utilizes the latest updated loop count 
value. 
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BRANCH PREDICTION METHOD USING ADDRESS TRACE 

Abstract of the Disclosure 
A branch prediction method using an address trace is described. An address trace 
corresponding to an executed instruction is stored itself with a decoded form. After j 
appointing a start address and an end address of a repeated routine, current routine 
accessing times and total accessing times are compared with each other, confirming the 
end of the routine and storing address information of the next routine. Therefore, access 
information of the repeated routine can be stored using a small amount of a trace cache. 



K:\Samsung\169\169patapp2.wpd 



SAM- 169 




Fig. 2B 



22 



A 


B 


C 


D 


LU 



Fig. 3 



for (i=1 ; i<30 ; i++) 



Operat ion A ; 
Operation B ; 



for (j=1 ; j<20 ; 



Operation C 
Operation D 
Operation E 



for (k=i ; k<40 ; k++) 



> Routine 1 



\ Routine 2 



Operation F 
Operation G 



> Routine 3 



Fig. 4 



(Prior Art) 



22 





A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


Routine 1 — 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 


A 


B 




A 


B 


A 


B 


A 


B 


A 


B 


C 


D 


E 


C 


D 


E 


C 


D 




E 


C 


D 


E 


C 


D 


E 


C 


D 


E 


C 


D 


E 


C 


D 


E 




C 


D 


E 


C 


D 


E 


C 


D 


E 


C 


D 


E 


C 


D 


E 


C 


Rout ine 2 — 


• • 

• • 

• • 






c 


D 


E 


C 


D 


E 


F 


G 


F 


G 


F 


G 


F 


G 


F 


G 




F 


G 


F 


G 


F 


G 


F 


G 


F 


G 


F 


G 


F 


G 


F 


G 


Rout ine 3 — 


• • 

• • 

• • 




F 


G 


| F 


G 


F 


G 


F 


G 


F 


G 


F 


G 


F 


G 


F 


G 



Fig. 5 




220 



Start 


End 


Current Access 


Old Access 


• • • 


NFP 


Address 


Address 


Loop Counter 


Loop Counter 





Fig. 6 



220 



A 
Add. 


B 
Add. 


i 


30 


C 
Add. 


E 
Add. 


j 


20 


F 

Add. 


G 
Add. 


k 


40 


• • • 



V 

Routine 1 



Routine 2 



Routine 3 



^0-^3U-15 18:01 FROM : HRNR PRT SEOUL 34537635 TO: 617 426 ££75 PRGE:0O£ 

li'll^^ 1 ^ 0 ™' SAMSl ^ TO: 71 169810023453763511 P pGE:01 

±a:4i FROM: NANA PRT SEOUL 34537635 TO : 033 1 2056630 PR^i00e 

_ JOV-^OOO^RI 04102 PILaBiUELS OAUTHtER STEVENS FAX NO. 6174263275 Pt 17/3] 



DECLARATION* PETITION AND POWER OF ATTORNEY FOR 
PATENT APPLICATION 



Attbtbw n*iKUK) lnv«wr, \ hereby dtelire ihllt 

My To&kJfiw, poit office adores* and cftircnsWp irtt *i stated betaw now K) my nunc, 

r bolivvo I m tb« original, tint *nd note tnv«mor (ft only one ««nw b Ifrwrf *mi™) «* *n onfcH»1, fimi *td ]*tot 
inventor (if ptat] **»ei fried Mow) of the mutiw which I* ciiimerf aid fcr wtacft a p***t & Wligm 
on rhc Jtivtwtot enitfted: 

Br*fftfi rrfttftcOm Mirtod Vilim Addrow Trier 

dw «p#dflortfon of wWrt (check only one); 

K , is attaohtd twrtito, 

M fikd ■ UiittPd States Fmoji Appticttton 

atrial No. -— , 



on. 



Wld wagamsniled 

on 



flW «ft KIT Fftlcnl A,»|i1**th*i 



SoUlNo. 



mi nmmdidiirtdir PCT Article 19 



I torrtyititttftt ! tiivc rericwed umfcr*t«id d* coat*** of** ^CU*^ MM*«mft«lnirm w 
amended by any amendment referred U> Irani*. 

I fttimowWrigft tot duly ta dlteloftt inffcnmtt™ which b nwwW to the CTwnin^oa ofthi* Appltestlort b 

icoorttottce with Tlflf 37. Coda of Fedwftl Regyjatini«, fi|J#. 

i h«diy cl*n fcrri* p torMy bemrfta ™*fcr Title 35, U».i.cd Sl^^!^"7*3^ 

tteUrited Statu of America Barf Mow end taw «1» kkntifi* W ippUc.Uo^»>toF«»« « 

Sme. of Arctic* flMby me,,, the nine w&ct matter twcvtalft * *»<> •-&«* * f ** « 



(ifi>criwdiaimPCT) 



datc of nuNO 



UTtfOMtTV CLAIMRD TfWDER 

I ^ — 



Psge lof 2 



00-NOU-15 18:01 FROM: HfiNfl PflT SEOUL 34537635 TO: 617 4B6 £275 PAGE : 003 

11-15 WS = 22 WED FROM : SAMSUNG 03318036630 TO: 711692100P34537&35U PPGE:(3£ 

Q0-HOV-13 10141 FROMrHOWft PPT SEOUL 34537635 TO:0331209G630 m<3E:00? 

_ J^^00^04^P« SMLS GTOIER STEVENS PAH NO. 81742B2275 P . jflyg, 



HECLARATION, PETITION AfcD POWER OF ATTOWWY FOR PATENT 
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Attorney Docket Ks>. 



J hcc^okim thotwrwfkumta- TWe 35, United StitfB Coflu, 0 Jlftt) Ofm UwMSWtoprtvllioMJ ftppll«itifift(t) 
w**ta? t*iaw ( 



APTUCATOWNUMBBR 



T Iwnrty otatm tHe brntflt under Titto 35 T Uohed S«*W* C*tr, § 1210 of «ty Uttfu*! State* nypKortMi > *CT 
ir*eTnatrcm*l «ppHcmkiK») desisnallng ihe Uniwl Stfftt ftf Americt Ifwt Jt/A» llitttf MlfW *nd. insofar at lltt 

*4>joct matter of cacb of tha clafaro uF(hU appl^^n I* nor diidased in ftatrtho* prior appl JoatMs} m the minr** 

provided by tJw rtm parish *milc 35> United 5i*$» 1 U3, 1 w atSCKjJC ^^JW 

InftjrmflUmi M drtlntt! to Title 37, Coda of Pcrfeml Reguliduro, $ 1 ,56 «*urr*d hHw^m tb# Mmft&fe ef 
the prior *ppjfe*lfc»t* Uw *i«ii<-o-y1 or rCT frttcmBtwo.il fltlp$ date of fftfo 4nf>JJnaltfm: 
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APPLICATION fcjUMBEft. 
fifPCT!^«tePCT> „ 



DATE OF f DUNG 



51 atu3; (rATEtmcp, rmrnmo 
OR ABANDONED) 



POWfl ft OF ATTORNEY; At - ***** fnv^ntw. I h*r*hy ****** too f* llowtns attotwy* ."Jp* 1 * * P™ 90 ™ 1 * 
this iiwJkftsbxi wrf tmnw* ill btatoew in tfit rMWftf *url Trtrtwwrk O W«5 connMHKl Itowfin. 



Matftvw Carroll 



lUfl No 34,443 
Rett No. 33,298 



Steven M. Mill* 



Rtfi- Nth 36.010 
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235 Fnmkiin StTMt 



ttoc^ ^eeMonK^ «vdi claim*. <md he^by *ub«r!I^ my w to «ptetficti«i «nd «m* » 0» 

fort?goi«g dwimipn, power or«t»ney» ana mis pocfekfa 

will evil mmma and m^lflLc «, in«to m puaMnbte by ftoc or imFftoomtwnf. ^ ^^^^^ 

■pf Ifcaiiuit or Wiy pvlcrU fwM«4 tbcfrxm 
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